I am working on an App which requires Audio / Video Chat... My problem is when I start capturing video the Audio Playing stops completely.
Technical Description I have used AudioTrack Class and AudioTrack.OnPlaybackPositionUpdateListener for audio playing. I have used Camera and Camera.PreviewCallBack for video Recording.
Now as soon as camera is started, the call back of AudioTrack class stops working. What can I do to handle this problem ? I have HTC's device which has Android2.2.
EDIT Since I can't post full code here... (I don't have access to the code of Video module), I am listing the scenario here:-
- Audio chat has been started and Audio is playing, which means onPeriodicNotification() is called properly..
public void start() {
bufferSize = AudioTrack.getMinBufferSize(sampleRateInHz, AudioFormat.CHANNEL_OUT_MONO, AudioFormat.ENCODING_PCM_16BIT);
if (bufferSize != AudioTrack.ERROR_BAD_VALUE && bufferSize != AudioTrack.ERROR) {
audioTrack = new AudioTrack(AudioManager.STREAM_MUSIC, this.sampleRateInHz, AudioFormat.CHANNEL_OUT_MONO, AudioFormat.ENCODING_PCM_16BIT,
this.bufferSize, AudioTrack.MODE_STREAM);
if (audioTrack != null && audioTrack.getState() == AudioTrack.STATE_INITIALIZED) {
Log.i(LOG_TAG, "Audio Track instance created buffer Size : " + this.bufferSize);
audioTrack.setPositionNotificationPeriod(320);
audioTrack.setPlaybackPositionUpdateListener(this);
// init All the jitter variables
initVariables();
// short[] tempBuf = shortBuffer;//new short[bufferSize / 2];
audioTrack.write(shortBuffer, 0, shortBuffer.length);
audioTrack.write(shortBuffer, 0, shortBuffer.length);
audioTrack.write(shortBuffer, 0, shortBuffer.length);
audioTrack.write(shortBuffer, 0, shortBuffer.length);
audioTrack.write(shortBuffer, 0, shortBuffer.length);
audioTrack.write(shortBuffer, 0, shortBuffer.length);
// start playback of the audioTrack
audioTrack.play();
} else {
Log.e(LOG_TAG, "Unble to create AudioTrack instance");
}
} else {
Log.e(LOG_TAG, "Unable to get the minimum buffer size");
}
}
@Override
public void onPeriodicNotification(AudioTrack track) {
try {
fillAudio(shortBuffer);
track.write(shortBuffer, 0, Constants.FRAME_SIZE / 2);
} catch (NullPointerException nex) {
nex.printStackTrace();
Log.e(LOG_TAG, "Null Pointer inside periodic notification");
}}
fillAudio() is a function which fills the Buffer...
- User clicks on the Video Chat Button which gets the camera using
Camera.open(), sets the parameters, callback and later starts the callback by usingcamera.startPreview()..
OnTouchListener cameraSurfaceOnTouch = new OnTouchListener() { int x = 0; int y = 0; int dx = 0; int dy = 0; boolean moving = false;
@Override
public boolean onTouch(View v, MotionEvent event) {
switch (event.getAction()) {
case MotionEvent.ACTION_DOWN:
x = (int) event.getX();
y = (int) event.getY();
dx = (int) event.getX() - v.getLeft();
dy = (int) event.getY() - v.getTop();
moving = true;
return true;
case MotionEvent.ACTION_MOVE:
if (moving) {
x = (int) event.getX() - dx;
y = (int) event.getY() - dy;
x = Math.max(x, 0);
x = Math.min(x, getWindowManager().getDefaultDisplay().getWidth() - v.getWidth());
y = Math.max(y, 0);
y = Math.min(y, getWindowManager().getDefaultDisplay().getHeight() - v.getHeight());
v.layout(x, y, x + v.getWidth(), y + v.getHeight());
}
return true;
case MotionEvent.ACTION_UP:
x = (int) event.getX() - dx;
y = (int) event.getY() - dy;
x = Math.max(x, 0);
x = Math.min(x, getWindowManager().getDefaultDisplay().getWidth() - v.getWidth());
y = Math.max(y, 0);
y = Math.min(y, getWindowManager().getDefaultDisplay().getHeight() - v.getHeight());
// v.layout(x ,y,x + v.getMeasuredWidth() , y
// +v.getMeasuredHeight());
moving = false;
return true;
}
// v.invalidate();
return false;
}
};
Callback videoPlayerCallBack = new Callback() {
public void surfaceDestroyed(SurfaceHolder holder) {
stopCapturerVideo();
if (converterID != -1 && x264Wrapper != null) {
x264Wrapper.destroyVideoFormate(converterID);
converterID = -1;
}
}
private void startCapturerVideo() {
if (m_CameraStatus == false) {
this.m_CameraStatus = this.videoCapturer.startCamera();
}
synchronized (this.m_videoCapturerBufferList) {
this.m_videoCapturerBufferList.clear();
}
byte[] tmp = new byte[10];
tmp[0] = Constants.VIDEO_SESSION_STARTED;
short width = 160;
short height = 120;
byte[] mIndex = CommonMethods.toByteArray(session.getSelfMeetingIndex());
byte[] aWidth = CommonMethods.toByteArray(width);
byte[] aHeight = CommonMethods.toByteArray(height);
tmp[1] = mIndex[0];
tmp[2] = mIndex[1];
tmp[3] = aWidth[0];
tmp[4] = aWidth[1];
tmp[5] = aHeight[0];
tmp[6] = aHeight[1];
tmp[7] = 0;
session.add(tmp, 8, 3);
aWidth = null;
aHeight = null;
tmp = null;
this.stopThread = false;
this.encodeAndSendThread = new Thread(encodeAndSendRun);
this.encodeAndSendThread.start();
this.videoCapturer.startCaptureringVideo();
}
public boolean startCaptureringVideo() {
boolean cameraStatus = true;
Log.e(LOG_TAG,"startCaptureringVideo called ");
if(this.mCamera != null)
{
try {
// this.mCamera.setPreviewDisplay(this.videoCaptureViewHolder);
this.mCamera.startPreview();
}
catch (Throwable e) {
cameraStatus = false;
mCamera.release();
mCamera = null;
}
}
else
{
cameraStatus =false;
}
return cameraStatus;
}
onPeriodicNotification()is never called again after step 2 even if I stop and release the camera.
What could be the possible reason for this,